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Texture  Study  of  Synthetic  Aperture  Radar (SAR)  Images 

of  Ocean  Surfaces 


I .  INTRODUCTION 


Microwave  oceanography  is  a  relatively  new  field  of  re¬ 
search  in  which  established  active  and  passive  microwave  tech¬ 
nologies  are  being  used  to  explore  various  ocean  properties.  One 
area  of  practical  interest  in  this  effort  is  the  search  for 
methods  to  acquire  measurements  which  would  allow  an  estimation 
of  the  wind  field,  wave  field,  and  meteorological  conditions  on 
the  ocean  surface.  This  report  is  related  to  the  segmentation  of 
synthetic  aperture  radar(SAR)  images  into  areas  where  significant 
difference  in  surface  wave  patterns  existed  at  the  time  when  the 
images  were  taken. 


Experimental  observations  conducted  in  recent  years 
have  verified  the  fact  that  ocean  surface  waves  and  patterns  can 
be  detected  in  SAR  images! 1-5}.  The  basic  physical  principle  of 
SAR  imaging  is  that  the  backscattered  microwave  energy  from  a 
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reflecting  area  sensed  by  the  radar  receiver  contains  information 
on  the  roughness  of  that  area.  However,  a  SAR  image  is  generated 
by  making  use  of  the  coherent  Doppler  information  associated  with 
the  motion  of  the  radar  relative  to  the  target.  Any  unaccounted 
for  motion  displaces  the  image  of  a  target  from  its  true 
position.  For  a  target  such  as  the  ocean  surface,  exhibiting 
movements  in  several  directions  and  on  different  scales,  image 
blurring  occurs  making  various  ocean  features  less  visible  to  the 
interpreter.  As  a  consequence,  there  is  no  complete  SAR  imaging 
theory  to  adequately  describe  the  response  of  a  synthetic  aper¬ 
ture  radar  to  changes  in  the  reflectivity  of  the  surface  of  the 
ocean . 


A  Radar  image  is  a  two-dimensional  map  of  the  variation 
in  the  local  coherent  backscatter ing  cross-section  of  the  il¬ 
luminated  target  surface.  For  ocean  images,  these  changes  will 
depend  upon  the  changes  of  local  surface  tilt  angle,  variation  of 
its  roughness,  height  and  size  of  the  waves,  the  wave’s  velocity 
and  its  direction,  the  polarization  of  the  radar  waves,  radar 
wavelength,  viewing  geometry,  uncompensated  platform 
acceleration,  etc.  The  wave  velocity  affects  the  image  in  an  in¬ 
direct  and  complex  way  because  of  the  way  the  image  is 
generated [ 6 , 7 ] .  The  process  involved  is  not  fully  understood. 
In  addition,  it  is  difficult  to  make  the  simultaneous  measure¬ 
ments  to  find  sufficient  ground  truth  over  a  significantly  broad 


area  within  the  image.  Hence,  there  is  still  no  acceptable  pro¬ 
cedures  which  can  be  relied  upon  to  generate  an  accurate  estimate 
of  ocean  wave  spectra  from  SAR  image  intensity  data  [8-11]. 

Since  a  direct  estimation  of  the  relevant  environmental 
conditions  is  difficult  to  achieve,  an  indirect  approach  of  seg¬ 
menting  the  SAR  image  into  areas  with  clearly  different  environ¬ 
mental  conditions  can  be  a  meaningful  alternative  for  ocean  sur¬ 
face  remote  sensing.  Tonal  classifiers  that  were  successful  in 
discriminating  areas  of  different  characteristics  in  multi- 
spectral  scanner(MSS)  Landsat  imagery  of  land  scenes  do  not 
produce  good  results  when  applied  to  radar  images.  The  main  dif¬ 
ficulty  is  due  to  the  effect  of  speckle,  a  coherent  noi3e 
phenomenon  associated  with  all  coherent  sensors,  which  tends  to 
reduce  interpretabi lity  of  the  image.  For  radar  images,  texture 
analysis  which  examines  the  intrinsic  spatial  variability  has 
turned  out  to  be  a  more  viable  approach  in  discriminating  among 
different  land-use  types  and  geological  f ormations [ 1 2- 1 4 ] .  Based 
on  thi3  experience,  an  attempt  has  been  made  to  study  the  rela¬ 
tion  between  the  texture  in  a  SAR  image  of  ocean  surface  and  the 
relevant  physical  conditions  giving  rise  to  this  texture,  namely 
the  wave  field  and  indirectly  the  wind  field. 
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II.  TEXTURE  APPROACH  TO  IMAGE  ANALYSIS 


Texture  is  an  intrinsic  characteristic  which  exists  in 
virtually  all  types  of  images.  It  has  been  a  subject  of  study  in 
image  analysis  and  classification  for  over  two  decades.  Although 
it  is  easy  for  anyone  to  recognize  its  existence  and  describe  its 
structure  in  simple  terms,  the  meaning  of  texture  has  not  been 
precisely  defined  nor  has  a  general  analytical  technique  to  ex¬ 
tract  numerical  measure  of  it  from  image  data  been 
es tabl ished [  1 5 ]  .  Mapping  semantic  expressions  into  precise  lan¬ 
guage  and  the  appropriate  equivalent  mathematical  formulation  can 
be  difficult.  Basically  texture  concerns  the  pixel  variation 
within  a  neighbourhood  in  an  area  which  constitutes  a  small  part 
of  the  whole  image. 

The  problem  may  be  viewed  from  two  aspects.  In  the 

first  aspect,  it  deals  with  the  tonal  primitives  or  local 
properties  and  in  the  second  aspect  it  deals  with  the  spatial  or¬ 
ganization  of  these  tonal  primitives.  Tonal  primitives  are 

regions  with  special  tonal  properties  such  as  the  average  and/or 
the  range  value  of  the  tone  level.  The  area  covered  by  these 
regions  are  composed  of  all  the  connected  pixels  with  a  similar 
property.  The  spatial  organization  may  be  random,  or  have 


specific  structural  or 
neighboring  primitives, 
have  to  address  both  aspec 


probabilistic  inter-dependence  among 
Methods  developed  for  studying  texture 
ts  of  the  problem.  There  have  been 


many  statistical  and  structural  approaches  developed  to  measure 


and  characterize  image  texture[15].  However,  each  approach  em¬ 
phasized  a  specific  narrow  aspect  of  a  problem  for  which  a  cer¬ 
tain  measure  of  success  was  achieved.  Yet  for  other  images  the 
same  approach  shows  serious  weaknesses  and  limitations.  Among 
the  approaches  available  we  selected  the  spatial  gray  tone  co¬ 
occurrence  probability  matrix  approach  to  extract  textural 
properties  from  blocks  of  the  SAR  image  data.  This  approach’s 
power  lies  in  its  computational  simplicity  and  its  invariance 
properties  under  monotonic  gray  tone  transformation.  It  has  been 
applied  quite  successfully  in  classifying  photom lcrograph ic 
images! 16],  in  identifying  objects  or  regions  of  interest  in 
LANDSAT  optical  images ( 1 7  ,  1 8  ]  ,  and  recently  in  land-use  and  sea- 
ice  type  discrimination  of  SAR  images [ 1 3 , 1 9 ] . 


III.  TEXTURE  FEATURES  EXTRACTION  FROM  SPATIAL  GRAY-TONE  CO¬ 
OCCURRENCE  MATRIX 

The  spatial  gray-tone  co-occurrence  matrix  method  of 
extracting  texture  properties  from  images  is  based  upon  the  as¬ 
sumption  that  the  texture  information  in  an  image  is  contained  in 
the  overall  or  average  spatial  relationship  which  the  neighbor¬ 
hood  pixel  gray  tones  maintain  with  respect  to  each  other.  In 
the  first  step,  a  set  of  probability  matrices  are  evaluated  by 


scanning  through  a  given  block  of  the  image.  The  next  step  is  to 
evaluate  a  set  of  feature  values  based  on  a  properly  chosen  for¬ 
mula  with  the  elements  in  these  matrices  as  the  arguments.  Fea¬ 
ture  values  are  numerical  descriptors  which  characterize  the 
statistical  or  structural  nature  of  the  texture  by  specific 
numbers.  Feature  values  obtained  from  known  samples  are  used  in 
the  classifier  design.  Feature  values  evaluated  from  unknown 
image  blocks  are  used  for  image  category  discrimination. 

The  gray-tone  co-occurrence  matrix  of  an  image  block  is 
defined  as  follows.  Suppose  the  image  block  to  be  analyzed  for 
texture  is  rectangular  and  has  Nc  resolution  cells  in  the 
horizontal  direction,  and  Nr  resolution  cells  in  the  vertical 
direction.  The  gray  tone  of  each  cell  is  quantized  into  Ng 
steps.  The  whole  image  block  is  digitized  as  a  two  dimensional 
function  of  Nr  by  Ne  cell  data.  The  dimension  of  the  matrix 
equals  Ng  .  Its  elements  are  the  relative  frequencies  or  prob¬ 
abilities  pi  ,  j  .  The  quantity,  pt  ,  ;  ,  denotes  the  probablity  of 
the  two  neighboring  cells  having  gray  tones  of  i  and  j 
respectively.  Quantities  i  and  j  take  on  integer  values  in  the 
range  from  zero  to  Ng-1.  These  matrices  are  symmetric  and  are 
also  functions  of  the  separation  distance  between  the  two  cells 
as  well  as  the  direction  of  their  separation.  The  distance  is 
counted  in  terms  of  the  numbers  of  cells  separating  the  two. 
Usually  there  are  four  angular  directions  to  be  considered  which 
are  the  horizontal,  vertical,  lower  left  and  upper  right.,  and 
lower  right  and  upper  left.  Many  types  of  textural  features  can 


be  extracted  from  these  matrices [ 1 7 ] .  They  are  defined  by  the 


familiar  statistical  terminology  with  the  corresponding  formulas 


using  the  matrix  elements  as  arguments  instead  of  the  usual  data 


samples.  The  special  physical  meaning  of  each  of  these  features 


as  related  to  the  image  data  composition  structure  can  be  visual¬ 


ized  by  carefully  examining  its  formula  definition.  Since  there 


are  many  possible  choices  of  feature  definitions,  not  all  will  be 


independent.  The  following  features  have  been  mentioned  by  many 


investigators  and  are  employed  in  this  study: 


1)  Uniformity 


f  i  =r  e  pi,j 


2)  Contrast 


f 2  =  E  E  <  i-j  > 


3)  Entropy 


■  -LL  pt  .  j  log  pi,, 


4)  Inverse  Difference  Moment 


f«  =  E  E  +  <  i  —  j  ) 


>>v-» “■>>>  « v- v  j-  j  . 


5)  Correlation 


f,  =  iZL  (  i  j  )  pt  ,  j  -/*  i  A1  ,  ]  /<*".  i  (  5  ) 


where 


/“.  --LL 


ipi  .  j 


/*j  =EE  jp*  • 

•'  j 


=  IIijpi.j  -  (EIip-  ■  j  ): 


j  =E£j*Pi-j  ~  iIEjpt.j >* 


IV.  IMAGE  CLASSIFICATION  ALGORITHM 


With  only  a  limited  number  of  samples  available  for 
training  purposes,  and  a  set  of  features  whose  probability  den¬ 
sity  functions  are  too  difficult  to  be  estimated,  pattern  class¬ 
ifier  based  on  Bayes  likelihood  ratio  test  can  not  be 
constructed.  A  simpler  and  more  feasible  procedure  to  handle 
this  problem  is  to  find  a  linear  discriminant  function  based  on  a 
minimum  mean-square  error  approach [ 20 , 2  1  ]  .  In  this  approach  only 
a  finite  number  of  available  training  samples  are  assumed  and  the 


discriminant  function  h(z)  separating  two  classes  becomes  simply 


h ( Z  )  =  WT  z 


(  6  ) 


where  T  indicates  the  transpose  of  the  vector  W  and  Z  is  the 
modified  sample  vector  of  n  feature  components  with  the  form 


Z  =  <  1  f  i  f2  f j 


i  7  ) 


The  linear  vector  W  is  defined  by 


W  s  (  U  L'T  )  -  i  U  f 


(8) 


where  U  is  a  matrix  constructed  of  the  training  sample  feature 
vectors  and  has  the  following  form, 


U  = 


e  i 


f. . 


l  -l 

fxi.l  ~  f  N  1  *  1  ,  1 


-1  > 
fn  *  i!  ,  i 


^  f  1  .  n 


f  x  I  .  n  -  f «  i  »  i 


I  t  N  !  ,  «  ' 


(  9 


N't  and  Nj  are  the  number  of  the  samples  in  the  class  1  and  class 
2  respectively.  The  first  subscript  in  the  matrix  elements  of 
(9)  refers  to  the  sample  sequence  number  and  the  second  subscript 
refers  to  the  texture  feature  sequence  number.  The  vector  p  has 


components  which  are  the  assumed  desired  output  of  the  function 


h(Z)  for  the  training  samples  in  (6). 

(Z)  =  [  TT  <  Zi  )  ------  S'fZ*  i  ♦  )  ]T  (10) 

In  the  work  reported  here,  all  the  compenents  in  (10)  are  assumed 
to  be  1.0.  For  a  feature  vector  obtained  from  an  image  block  of 
class  1,  the  discrimination  function  h(z)  will  yield  a  ,  positive 
result  close  to  1.0.  A  feature  vector  evaluated  from  data  in 
image  block  of  class  2  will  yield  a  negative  result  close  to 
-1.0. 


In  the  multicategory  cases,  linear  vector  W  is 
evaluated  from  training  sample  data  for  each  possible  pair  of 
classes.  For  an  image  block  of  unknown  class  to  be  classified, 
its  feature  vector  is  tested  against  all  the  linear  vectors  in 
(6).  The  class  which  scores  the  highest  is  the  category  to  which 
the  unknown  block  is  assigned.  If  there  is  a  tie  between  two 
classes,  the  result  of  the  discrimination  function  with  the  vec¬ 
tor  W  made  from  these  two  classes  settles  the  ambiguity.  If 
there  are  more  than  two  classes  with  the  same  score  in  the  class¬ 
ifying  process,  an  undecided  case  appears.  This  situation  can 
happen  if  more  than  three  classes  exist. 
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V.  CLASSIFICATION  RESULTS 


The  images  being  used  to  test  the  classification  algo 
rithms  are  shown  in  Figures  la,  2a,  and  3a.  Figure  la  shows  the 
image  of  Chesapeake  bay  generated  by  appropriate  processing  of 
the  Seasat-A  SAR  video  signal.  It  was  taken  on  August  5,  1978. 

Figures  2a  and  3a  are  sub-images  obtained  during  the  SIR-B  mis¬ 


sion  on  October  11,  1984 

the  U.  S.  east  coast, 
around  the  geographical 
Figure  3a  shows  the  image 
All  3  images  have  the 


They  cover  the  ocean  surface  outside 
The  area  shown  in  Figure  2a  is  centered 
location  at  37°  North  and  74°  West, 
of  New  York  Bight/Hudson  canyon  area, 
size  of  512  by  512  pixels ( resolution 


cells)  . 


In  our  classification  experiments  with  the  image  of 
Fig.  la,  several  sub-images  of  size  32  by  32  resolution  cells  are 
chosen  within  the  image  as  the  training  samples.  Linear  vector 
functions  W  were  derived  from  the  feature  data  which  are  average 
values  in  four  directions  of  uniformity,  contrast,  correlation, 
and  entropy.  Four  categories  of  land  use  were  chosen  in  this 
image.  They  are  the  water,  rural  area,  small  town  urban  area, 
and  man-made  structures  such  as,  the  bridges.  Four  or  five 
training  samples  were  selected  for  every  category.  In  the  class¬ 
ifying  process,  a  window  of  33  by  33  pixels  is  scanned  through 
the  whole  image  starting  at  the  upper  left  corner.  The  texture 
features  evaluated  with  the  pixel  data  within  each  window  were 
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used  in  equations  (6)  and  (7)  to  determine  the  category  of  this 


window.  A  new  image  shown  in  Fig.  lb  was  created  with  the  pixel 
location  corresponding  to  the  center  of  this  window  assigned  a 
chosen  tone  level  for  that  category.  This  image  has  a  size  of 
496  by  496  pixels  since  the  16  pixels  along  the  edge  could  not  be 
classified.  The  chosen  pixel  tone  levels  are  0,  50,  150,  200  for 
water,  rural  area,  small  town  urban  area,  and  the  man-made  struc¬ 
ture  respectively.  The  undecided  pixels  were  assigned  a  level  of 
255.  To  enhance  the  distinction  between  these  categories  for 

S 

viewing,  pseudo-color  was  used  with  dark  blue  corresponding  to 
zero  pixel  value  and  bright  red  corresponding  to  the  maximum 
pixel  value  of  255.  With  this  color  coding,  the  water  category 
appears  as  black,  rural  area  appears  as  light  blue,  small  town  as 
green  and  man-made  structure  as  orange.  The  undecided  pixels 
show  red  color.  By  comparing  Figures  la  and  lb,  it  is  evident 
that  co-occurrence  matrix  method  of  generating  texture  features 
for  image  classification  yields  excellent  results.  This  image 
was  used  as  a  sample  to  test  the  power  of  this  classification  ap¬ 
proach  and  t'  check  the  accuracy  of  the  algoritms  and  programs 
developed . 


The  image  shown  in  Fig.  2a  is  a  difficult  one  to 
cLassify.  In  some  parts  of  the  image,  the  pixel’s  intensity 
variations  reveal  directional  streaks  as  compared  with  other 
parts  where  it  is  more  or  less  homogeneous.  The  areas  with  the 
streaks  indicate  the  regions  on  the  ocean  surface  where  stronger 
waves  and  winds  may  exist.  Our  objective  was  to  develop  the  al- 
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gorithms  and  programs  which  will  enable  us  to  use  the  computer  to 
map  the  image  automatically  into  streak  and  non-streak  areas. 
Since  regions  with  the  same  textural  properties  cover  broader 
area  in  this  image,  a  larger  size  of  64  by  64  pixels  was  chosen 
for  the  training  sample.  About  four  or  five  of  both  categories 
were  selected.  Features  of  uniformity,  contrast,  entropy,  in¬ 
verse  difference  moment,  and  correlation  in  all  four  directions 
were  evaluated.  A  pair  among  these  five  which  showed  consistent 
and  greatest  percentage  difference  in  all  four  directions  between 
these  two  categories  of  training  samples  was  chosen  as  the  fea¬ 
ture  vector  components  in  equations  (7)  and  (9).  Figure  2b  shows 
one  of  the  better  results  obtained.  The  image  in  Figure  2a  was 
divided  into  64  subimages  of  64  by  64  pixels  each.  Pixel  data  in 
each  sub-image  were  used  to  determine  that  sub-image’s 
classification.  The  blank  cells  in  Figure  2b  indicate  that  the 
corresponding  sub-images  in  Figure  2a  were  classified  as  region 
without  streaks  and  those  cells  labeled  with  letter  S  indicate 
sub-images  classified  as  region  with  streaks.  The  training 
samples  chosen  do  not  coincide  with  any  one  of  these  sub-images. 
Our  subjective  judgement  of  the  classification  accuracy  is  that 
il  is  60%  to  70%,  based  on  careful  examination  of  these  sub- 
i mages . 


The  image  in  Figure  3a  was  classified  in  a  wav  similar 
to  that  of  the  image  in  Figure  2a.  Three  classes  of  training 
samples  were  chosen.  The  first  two  classes  are  the  same  as  those 
chosen  from  image  in  Fig.  2.  The  third  class  training  samples 


Fig  3,i  —  SIR-B  image  of  ocean  surface  at  Ne« 
York/ Hudson  canyon  area 


were  selected  in  Figure  3a  in  the  areas  where  large  size  streaks 


are  evident.  Since  the  intensity  level  of  the  pixels  in  Figure 


3a  varies  over  much  broader  range  than  that  of  Figure  2a,  mean 
values  of  each  sub-image  were  re-adjusted  to  equal  the  level  of 
one  of  the  training  samples  of  Figure  2  before  feature  values 
were  evaluated  for  both  the  training  and  classifying  process. 
Figure  3b  shows  one  of  the  better  results.  The  blank  cells  and 
the  cells  labeled  SS  indicate  the  corresponding  sub-images  in 
Figure  3a  which  were  classified  as  belonging  to  the  same  classes 
of  non-streak  and  streak  regions  as  those  in  Figures  2.  The 
cells  labeled  LS  indicate  that  the  corresponding  sub-images  were 
classified  as  regions  with  large  streaks.  Again,  subjective 
evaluation  of  the  result  indicates  a  classification  accuracy  of 
around  70%.  This  is  much  better  than  we  achieved  for  the  image 
of  Figure  2,  because  this  i3  a  three  class  problem  as  compared 
with  that  of  a  two  class  one.  However,  it  is  apparent  that  the 
image  of  Figure  3a  is  one  which  should  be  much  easier  for  class 
separation.  The  results  of  classifying  Figures  2a  and  3a  are  not 
as  good  as  was  expected.  No  attempt  was  made  to  classify  each 
pixel  and  generate  a  new  image  as  was  done  in  creating  the  image 
in  Figure  lb  for  the  image  in  Figure  la.  It  is  anticipated  that 
a  clear  partition  of  the  image  into  two  or  three  classes  of 
regions  is  unlikely. 
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VI.  CONCLUSIONS  AND  DISCUSSIONS 


This  effort  in  the  texture  study  of  SAR  images  confirms 
the  fact  that  the  texture  features  derived  from  co-occurrence 
matrix  method  are  quite  powerful  in  land  use  or  terrain  class¬ 
ifications  of  radar  images.  The  method’s  applicability  to  images 
of  the  ocean  surface  is  still  under  investigation.  Ocean  images 
generally  fall  into  two  classes.  Those  that  exhibit  only  subtle 
differences  in  texture  between  different  regions  and  those  that 
show  more  pronounced  differences.  For  the  current  work  we  have 
deliberately  selected  imagery  in  the  first  category.  It  is  ap¬ 
parent  that  for  such  images  the  method’s  discriminating  power  is 
less  effective  than  for  images  of  land  scenes.  It  is  conceivable 
that  a  different  combination  of  features  or  parameters  in  the 
matrices  may  to  some  extent  improve  this  situation.  However,  a 
truly  significant  improvement  in  its  texture  distinguishing 
capability  for  images  in  the  first  category  may  not  be  possible. 
In  this  case,  to  continue  the  goal  of  separating  ocean  surface 
SAR  image  into  regions  having  different  environmental  conditions 
through  texture  study,  a  different  approach  may  have  to  be 
pursued.  The  approaches  will  be  tried  which  seemed  to  have 

worked  well  on  similar  problems  as  shown  by  recent 


invest i gat  ions . 


These  are,  the  texture  energy  measure 


approach [ 22 , 23 ] ,  the  Fourier  analysis  texture  feature  extraction 
approach [ 24 ] ,  and  the  non-linear  transformation  of  local  patterns 
approach ( 25  ]  .  As  far  as  the  second  category  of  images  is 
concerned,  typical  imagery  is  being  collected  and  it  will  be  used 
for  a  further  evaluation  of  the  co-occurrence  matrix  approach. 
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